Accelerating of Modified Policy Iteration in Probabilistic Model Checking
نویسنده
چکیده
Markov Decision Processes (MDPs) are used to model both non-deterministic and probabilistic systems. Probabilistic model checking is an approach for verifying quantitative properties of probabilistic systems that are modeled by MDPs. Value and Policy Iteration and modified version of them are well-known approaches for computing a wide range of probabilistic properties. This paper tries to improve the performance of modified policy iteration. Our approach is to use some information of the related model for approximating a good value for the number of iterations for each policy and improving this approximation in next modifications of policies.
منابع مشابه
Marginal Checking of a Markovian Degradation Unit When Checking Interval Is Probabilistic
Marginal checking of a Markovian degradation unit is treated when time interval to the next checking is not fixed but obeys a certain general distribution. The problem of determing the optimal set of the states at which the unit is replaced with a new one (marginal set) is discussed. It is solved by using Markov-renewal programming with modified policy iteration cycle. It is showed that control...
متن کاملThe Reliable Hierarchical Location-allocation Model under Heterogeneous Probabilistic Disruptions
This paper presents a novel reliable hierarchical location-allocation model where facilities are subject to the risk of disruptions. Based on the relationship between various levels of system, a multi-level multi-flow hierarchy is considered. The heterogeneous probabilistic disruptions are investigated in which the constructed facilities have different site-dependent and independent failure rat...
متن کاملEfficient Algorithms for Time- and Cost-Bounded Probabilistic Model Checking
In the design of probabilistic timed systems, bounded requirements concerning behaviour that occurs within a given time, energy, or more generally cost budget are of central importance. Traditionally, such requirements have been model-checked via a reduction to the unbounded case by unfolding the model according to the cost bound. This exacerbates the state space explosion problem and significa...
متن کاملQuantitative Analysis and Model Checking
Many notions of models in computer science provide quantitative information, or uncertainties, which necessitate a quantitative model checking paradigm. We present such a framework for reactive and generative systems based on a non-standard interpretation of the modal mu-calculus, where x: / x: are interpreted as least/greatest fixed points over the infinite lattice of maps from states to the u...
متن کاملOptimal Policy of Condition-Based Maintenance Considering Probabilistic Logistic Times and the Environmental Contamination Issues
One important issue in using the industrial and manufacturing facilities is to consider their impacts on the environment. Many of these equipment have negative effects on the environment when operated for sometimes. In this research the probabilistic logistic times and the destructive effects for maintenance are studied and appropriate model is suggested and evaluated. The aim of the proposed m...
متن کامل